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GRAPHICAL TECHNIQUES FOR THE PRESENTATION OF 
INTERLABORATORY STUDY OATA - A DIAGNOSTIC AID 

S. Cussion- and O.E. King, Laboratory Services Branch, Environmant 
Ontano, 125 Resources Rd., Rexdale, Ontario. M9W 5L1 

ABSTRACT 

Historically, most interiaboralory studies have documented current 
psrlormance and evaluated the performance against a standard in tabular 
lorm. Graphical techniques of evaluation provide for a more immediate 
companson o( performance and a greater incentive for participants to 
improve their performance. Examples from a series of interiaboralory studies 
co-ordinated by Latwratory Services Branch of Environment Ontario durino 
1988-90 demonstrated this approach. 

INTRODUCTION 

The role ol the interiaboralory or collaborative study to establish the 
precision of an analytical pnacedura is wall established. The American 
Society for Testing and Materials (ASTM) and the Association o( Ollidal 
Analytical Chemists (AOAC) have published guidelines for conducting this 
type o( study (i, 2). The data is treated and summarized using classical 
statistical techniques and an accepted standard of performance is 
established. 

Interiaboralory performance studies are then used as a means ol monitoring 
the ongoing periormance of a group of analytical laboratories that are testlnfl 
environmental samples. These studies have three functions: documentation 
ol current performance, evaluation of that periormance against a standard, 
and Inducement to improve both individual and group laboratory performance 







(3). There are many examples In the literature of interiaboralory 
periormance studies that tabulate current performance and evaluate the 
performance against a standard using classical statistical techniques. Less 
frequently are the interiaboralory studies used to locus on ways to improve 
an individual laboratory's performance. 

MOE LABORATORY SERVICES BRANCH APPROACH 

The L^joratory Services Branch (LSB) of Environment Ontario Initialed a 
series of Intertaboratory Perfonnance Management Studies in 1983 in 
support of the ministry's Municipal and Industrial Strategy lor Abatement 
(MISA) Program. The studies were designed not only to document the 
curent level of performance of laboratories capable of perfonning MISA 
analyses, but ^so to be used as a tool lor Improving an individual 
laboratory's performance. Each study focused on a specific MISA analytical 
test group or groups (4), with diHerent tests being repeated over time so as 
to monitor improvements in performance. 

The traditional approach of reporting intertaboratory means, nwdians. and 
standard deviations for the various parameters has been included lor the 
LSB Studies, as they provide a familiar form of comparison for the 
participants. Hov»ever the assessment of each individual laboratory's 
pertormance. and the recommendations for inprovemenl are based on 
ditlarent graphical techniques. 
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The Youden two-sample plot (2) is a well-estabtlshed technique for 
assessing tntralaboratory precision. Traditionally it has been applied to 
single-parameter tests. The standard deviation of the results can be used to 
calculate a limit for acceptable performance, with outlying laboratories 
flagged (Figure 1). This approach worlcs effectively for most conventional 
and inorganic analyses. 

By applying the Youden two sample technique to the results frorti an organic 
gas chromatographic (GC) scan, the interanalyte repeatability and bias may 
be assessed for an individual laboratory (Figure 3). Tolerance limits may be 
assigned or calculated, to rank the precision and the bias of the data set. 
Outlying parameters may be flagged, as opposed to flagging an outlying 
laboratory. 

To assess a laboratory's performance across a GC scan, the results from a 
sample may be converted to percent recovery of the design value, arranged 
in elution order, and presented as a bar graph (Rgure 5). Trends across 
tha scan may be noted, with recommendations for Improvement. This may 
include patterns of increasing or decreasing recovery, suggesting 
adjustments for the GC temperature programming. A specific group of 
parameters within the scan may be over- or under-recovered, suggesting 
problems with extraction efficiency. Individual problem parameters are easily 
Identified, and steps can be taken to check calibration standards or the 
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app opriateness of the method for a specific parameter. 

The following examples from several different LSB Intertaboratory Studies 
demonstrate how these graphical techniques may be used as a diagnostic 

aid to help Improve laboratory performance. 

1 

EXAMPLES 

Intarlaboratnrv Study 89-6: Metals and Hydride s 

Intertaboratory Study 89-6 was conducted In September 1989 to assess the 
intertaboratory variability for the analysis of metals and hydrides in spiked 
reagent water. A total of 36 laboratories participated in this study (5). 

The traditional Youden two-sample plot was used to assess the results from 
this study (Figures 1 and 2). To evaluate the results and determine 
outliers, a pooled standard deviation of the . two spiked samples was 
calculated (5). This acceptance criteria is indicated by the circle on each 
plot and outlying laboratories are flagged. The location of the outlying 
results in either the upper right or lower left quadrants, demonstrates either 
a systemic high or low bias, usually associated with a difference in 
calibration standards. 

Interlabora tnr y Study 69-5: Acid and Base/Neutral Ext raetaSles 
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Inlodaboratory Study 89-5 was conducted In May 1989 to assess tho 

Interlaboralory variability tor the analysis of acid and b^e/neutral 
extractables In spiked reagent water. A total of 15 latioratories participated 
in this study (6), 

The Youden two-sample technique was applied lo the results across the QC 
scan after converting the results to percent recovery ol the design value. 
Tolerance limits of ±20% for performance were assigned (Figures 3 and 4). 
Interanalyte repeatability can be deemed scceptitf)le if all the data pairs tall 
within the tolerance limits, as demonstrated In Figure 3. Biases within the 
scan can be easily recognized as demonstrated in Figure 4. 

Intarfaboratotv Study S9-1: Volatile Oroanics 

Intertaboratory Study 89-1 was conducted In January 1989 to assess the 
interlaboralory variability for the analysis of volatile organics in spiked 
reagent water. A total ol 16 laboratories participated In this study (7). 



program may initially be too high, resulting in volatilization ol the target 
parameters. Parameters that are over-recovered are readily Identified, 
suggesting that the calibration standard should be cross-checked (or 
accuracy. The results for L^oratory 1014 Indicate a subset of parameters 
that demonstrate a pattern ol decreasing recovery across the scan. This 
may Indicate that the method used by this laboratory is not appropriate for 
the analysis of these parameters. 

CONCLUSION 

Graphical presentation oi interlaboralory data can fadlttale Interpretation, and 
reveal patterns that are not detected by tabular or statisticai summaries. 
They provide a fresh perspective and insights Into relationships which may 
otherwise be overlooked or missed, providing greater Incentive to Improve 
laboratory perfonnance. 



To assess the performance across the GO scan, the results were converted 
to percent recovery of the design value, an'anged in approximate order ol 
elution, and plotted as a bar graph (Figure 5). The results demonstrate 
various patterns of performance. L^tioratory 1007 demonstrates a pattern ol 
Increasing recovery across the scan, suggesting that the temperature 
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FIGURE 1 

FIGURE Z JNTEfnABORATORY STUDY 88-6 
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FIGURE Z 



FIGURE l2:NTERLA8OBAT0RY STUDY BB-fl 



I. 1-S 



0.B 

a? 
o.« 
as 

IM 



fi 


3036 


sast 


y 


0.3 o.< 


a.c aa i t.2 i* i..« i,& a 



saanf ten (mi) 



e«i 



'iii 



FIGURE 3 
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FIGURE 4 
INTERANALYTE BIASES 
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